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Apparently the only empirical evidence of this overlap is the correla- 
tion of .77 on twelfth grade pupils’ scores between the Watson-Glaser 
Test of Critical Thinking , and the Martin Reading Comprehension Test . 
which Glaser (1941) described as a test of critical reading. 

The objectives of this study were to determine empirically the 
phenotypic interrelationships and factor structure of critical reading 
tests and subtests from which genotypic inferences could be made about 
the definitions of critical reading, critical thinking, and also the 
relationship between critical reading and critical thinking. 

This study reports the primary statistical analysis of a fifth 
grade critical reading data collection, half of a research program exam- 
ining empirically the definition of critical reading. The other half 
is a twelfth grade data collection < 

PROCEDURE 

The subjects (Ss) were 50 typical fifth grade pupils at Ballast 
Point Elementary School, Tampa, Florida. Most pupils were white and of 
lower or middle socio-economic class. 

Two cooperatively developed critical reading tests, the Intermedi- 
ate Reading Test - Science (CR SCI) (Maney, 1958), and the Intermediate 
Reading Test - Social Studies ( CR SS) (Sochor, 1958) , and one critical 
thinking test, the Cornell Critical Thinking Test Form X ( CT ) (Ennis 
and Millman, 1961) were administered in December, 1969. The Ss had 
already taken the California Test of Mental Maturity Level 2 Short Form 
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(CTMM) (California Test Bureau, 1964) and the Metropolitan Achieve- 
ment Tests Intermediate Level Form Am ( METRO ) (Durost, et al., 1959). 
The following tests and subtests were used: 

Intermediate Reading Test - Science (CR SCI ) total test 
Literal Reading (LR ) sub test 
Critical Reading ( CR ) subtest 

Intermediate Reading Test - Social Studies (CR SS ) total test 
Literal Reading (LR ) sub test 
Critical Reading (CR) sub test 
Cornell Critical Thinking Test Form X ( CT) total test 
Induction (IND ) subtest 
Reliability. ( REL) sub test 
Deduction (PEP) sub test 

Finding Assumptions ( FIND AS SUMP ) sub test 
California Test of Mental Maturity (CTMM) 

Language (LANG ) sub test 
Mon-Language (N ON-LANG ) subtest 
Metropolitan Achievement Tests ( METR O) 

Word Knowledge (WORD ) subtest 

Reading ( READING) subtest 

Spelling ( SPELLING ) sub test 

Language Study Skills ( LANG SKILLS ) subtest 

Arithmetic Computation ( ARITH COMP) subtest 

Arithmetic Problem Solving (ARITH PROB SOLV ) sub test 



Social Studies Study Skill s (SS SKILLS) subtest 
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CR SCI CR and CR SS C R purportedly measure commonly 12 specific 
critical reading skills. In addition CR SCI CR purportedly measures 
two additional and CR SS CR one additional critical reading skill. 

The CTMM and METRO scores were stanines. 

Pearson product moment correlations were calculated to determine 
the subtest score matrix, and the total test score matrix, independently. 
Principal components factor analysis and Kaiser Varimax rotation of all 
factors with eigenvalues in excess of one were conducted for the sub- 
test score matrix, and the total test score matrix, independently. 



RESULTS 

Table 1 indicates the intercorrelations for the 17 subtests. 

Ns ranged from 34 to 49 for the different correlations as not all 
students took all subtests. Ns, means, and standard deviations are not 
presented herein but are available upon request. 

Correlations of .34- and .44 are significant at the .05 and .01 
levels respectively for a sample of 34, the smallest sample. The crit- 
ical correlation between CR SCI CR and CR SS CR is .63. 

CR SC I CR , CR SS LR , CR SS CR , CT PEP , CTMM LANG , CTMM NON- LANG , 
METRO WORD , METRO’ READING , and METRO SS SKIL LS- generally intercorrelated 
around .50 and apparently represent considerable common variance. 
Another, probably separate, cluster of slightly higher correlations is 
composed of METRO ARITH COMP , METRO ARITH PROS SOLV , and METRO SPELLING . 
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It should be noted that these three subtests also correlate .54 or 
higher with METRO SS SKILLS but generally not nearly as high as with 
the other subtests with which METRO SS SKILLS clusters. It should also 
be noted that CR SCI LIT correlated .45 with CR SS LIT but lower with 
all other variables. This is probably a function of its low reliabil- 
ity (OE = .29, KR = .24). 

Table 2 indicates the subtests’ means, standard deviations, unro- 
tated and rotated factor loadings, % s of variance accounted for by 
each factor, and eigenvalues. 

N was 32 for the factor analysis and rotation. The analysis 
indicated a general factor accounting for 46% of the variance with mod- 
erate to strong loadings from all variables except CR SCI LIT which 
loaded .38, and CT FIND ASSUMP which loaded .36. These two variables, 
and CR SS LIT , METRO SPELLING , METRO ARITH COMP , and METRO ARITH PROB 
SOLV all loaded in excess of .40 on Factor II. Factor III had loadings 
of .57 from CT REL , .48 from CT FIND ASSUMP , and four other loadings 
ca. .35 each. Factor IV had loadings of -.60 from CT IND , .43 from 
METRO LANG SKILLS , .41 from CR SCI CR , and -.35 from C R SCI L IT. 

Rotation broke down the general factor into four group factors. 

The major group factor, accounting for 38% of the variance, consisted 
essentially of CR SCI CR , CR SS LIT , CR SS CR , CT PEP , CTMM NON-LANG , 
METRO WORD , METRO READING , and METRO LANG SKILLS . This factor is con- 
sidered to be a complex of language, reading and thinking activities 
particularly vocabulary, reading, interpretation, inference. 1c is 



H 


W 




g 




g 


K 


H 


g 


Pd 


n 


0 


n 


0 


0 


n 


n 


0 


0 


0 




5 ^ 


H* 


W 


td 


H 


w 


Ed 


w 


1 


H 


H 


H 


H 


H 


pd 


pd 


Pd 


Pd 






QQ 


O 


H 


H 


H 


H 


H 




H 


pc 












O 


0 


Hi 


Pd 


Pd 


pd 


Pd 


Pd 


Pd 


Pd 


g 


*1 


Cd 


Pd 


H 


CO 


CO 


CO 


CO 




Hi 


d 




O 


O 


o 


o 


o 


o 


O 






H 


w 


w 


25 


CO 


CO 


0 


0 




c. 


<J 


















25 


r 4 


25 


cd 


r 4 


td 






H 


HI 






Cl 


1 


CO 


> 


> 


£ 


CO 


Pd 




O 


> 


Cd 








n 


tr» 








ro 


H 


ro 


CO 


Pd 


pd 


i 


►"d 


w 


0 


25 


ZJ 










pd 


M 


O 


tr< 






C 






M 


H 


M 


> 


s 


1 


0 


> 








H 


Pd 


H 




o 


(D 


tii 


CO 


H 


H 


o 


f 4 


cd 


a 


£ 




CO 












H 




Hi 


CO 


o 


X 


« 


Pd 




f 4 


H 




> 




CO 






















o 


H 








H 


2 ; 




2 J 




rl 


















rt 




o 




*TJ 


o 




25 


Q 




O 






















tr 




£ 




Pd 


o 




O 










n 3 


















rt> 




£ 


CO 


o 


g 
































0 ) 




rt 




td 


































0 > 




a> 










































& 




CO 


































Hi 








o 




























r * 






o 




Hi 




trj 


































C 




o 




<J 


































H 




H 






































Hi 






























H 


H 


H 


H 






til 






CO 




•> 




Co 


•> 




Co Co CO 


ON 


vo 


to 


H 


vo 


to 


vo 


XI 


O 

rt 






'O 


•> 


CO 


ON 


H 


co 


CO 










Co 


to 


ON 


ro 


*0 


ON 


O 






00 




H 


CO 


ON 


4 s 


00 


H 




00 


H 


O 


to 


vo 


ro 


00 


vo 




H 










































0 ) 










































til 






H 


H 


H 


to 


H* 


H 


H 




to 


H 


to 


CO 


CO 




Co 


Co 


to 




O 








































00 


O 






ON 


On 


00 


H 


00 








O 


r j 0 


vo 


0 


ON 




4 N 


Co 


Co 


a 


o 






On 


On 


O 




-o 






VO CO 


H 


ro 


CO 


00 


ON 


O 


vo 


to 




c 










































!d 










































rt 










































fD 










































CL 




s> 










































ON 






































Hi 


• 


• 






































O 


00 


to 


00 


On 


ON 


ON 




OO 


00 


'd 


ON co 


-0 


Co Co 








CO 


H 


H 


ON 


Co 


o 


On 


CO 


CO 


Co 


^ J 


O 


to 


'O 


ON 


Co 


ON co 






4 ^ 


00 




a" 










































*<5 




H 








































H 


o 












1 




t 


1 




r 






1 


1 


1 


1 




rt 


• 


• 




































M 


& 


00 


00 


J— i 






M 






O 


to 


CO 


Co 


0 


H 


H 


CO 


Co 


O 


co 


H 


(D 


Co 


Co 


On 


00 


4 ^ 




H 


VO 


O 


00 


H 


0 


Co 


ON 


ON 


ON 


O 


Co 


Co 




CO 










































(D 










































Hi 


H 




\ 


1 


1 


1 


1 






1 


1 




1 












1 




o 


• 


* 




































M 


C 


CO 




o 


co 


co 


H 


M 


to 


O 


0 


H 


4 > 


H 


CO CO 


ro 


H 


O 


CO 


M 


H 


H 


H 


00 




H 


•O 




co 


O 


CO 


4 > 


00 


Co 






ON 




to 


00 


H 


Hi 










































til 










































O 


M 


on 


1 


1 


1 




1 






\ 


1 






1 


1 








) 




rt 


• 


• 




































M 


O 


H 


Co 


H 


o 


H 




H 


H 


O 


H 


H 


H 


ro 


to 


ON 


to 


O 




CO 


< 


H 


H 


CO 




on 


to 


CO 


Co 


ro 


00 


Co 


00 


to 


H 


0 


0 


0 




H 


Co 




CO 










































e 










































o 










































rt 














































CO 










































00 






































O 




• 






































Hi 




-£> 




H 


H 


Co 


ro 


00 


ON Co 




ro 


ON 


CO 


0 


00 






to 


H 








H 








co 


H 


H 


00 


ro 


CO 


Co 


-d 




00 


-d 


CO 




rt 




H 






































O 




CO 






































rt 




O 






































til 




• 










00 




























H 




o 


ON 


00 


00 


Co 


ro 




to 


to 


ro 




H 


to 


0 


O 


CO 


H 


H 








K - 4 


ON 


H 


CO 




Co 


Co 


'O 


00 


ON 


ON 


CO 


-d 


Co 


co 


ON 


0 


H 


s 




H 






































l 

to 










































» 












1 


































• 




































H 






co 


(.O 


M 




H 


ro 


co 


to 


to 


to 




0 


Vj 


CO 


ro 


ro 


0 


0 


H 






tO 


Co 


CO 




CO 


ON 


a> 


CO 


VO 


H 


ON 


co 


co 


to 


ON 


Co 


H 


H 


H 






H 










































H 












































1 


1 


1 




t 


1 


i 


l 


1 




1 




1 


1 


1 




1 








• 




































H 






H 


H 


o 


O 


H 


H 


H 


H 


Co 


Co 


H 


H h‘ 


H 


co 


O 


00 


< 










H 


Co 


Co 


O 


ro 


H 


to 


0 


CO 


co 


CO CX) 


4 > 


CO 




H 





a 

3 

H 

O 

rt 

M 

rt 

(D 



pd 

O 

rt- 

tu 

rt 

fD 

CL 




Subtests 1 Means, Standard Deviations, Unrotated and Rotated Factor Loadings 



John Follman 
Fage 7 



difficult to generalize more molecularly without an analysis of items 
within each subtest, and within each total test. The second group 
factor was composed primarily of METRO SPELLING , METRO ARITH COMP , 

METRO ARITH PROB SOLV , METRO SS SKILLS . This factor was essentially 

a study skills and numerical, arithmetic computation factor. Factor 

III was a doublet, composed of CT IND and CT REL . It is seen as 
essentially concerned with relevance of evidence, and whether or not 
evidence supports or contradicts a particular conclusion, an activity 
apparently disparate from all others measured herein. Factor IV has 
a loading of -.81 from CR SCI LIT and other smaller loadings with 
different signs. Since CR SCI LIT had such low reliability estimates, 
and generally low correlations with the other variables, it is con- 
sidered that this factor represents primarily error variance. 

Table 3 indicates the totai test score intercorrelations for 
CR SCI , CR SS , CT , CTMM , and METRO LANG . 

•Table 3 

Total Test Score Intercorrelations 



> 


CR SCI 


' CR SS 


CT 


' CTMM 


METRO LANG 


CR SCI . 


• 










CR SS 


.70 










CT 


.55 


.60 








CTMM 


.57 


.66 


.49 




• 


METRO LANG 


.41 


.41 


.49 


.40 





All correlations significant at .01 level. 



O 



9 
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Ns for these correlations were 46, 44, 41, 42, 43, 43, 44, 38, 

44 respectively since not all students took all tests. Means and 
standard deviations are available upon request. 

The most important correlation is .70 between C R SCI and CR SS , 
the two critical reading tests. This correlation indicates that 49% 
of the things measured by the two tests is the same. The other impor- 
tant finding is that CT correlated .55 and .60 with CR SCI and CR SS 
respectively. For these two correlations the common variance is 30% 
and 36% respectively. CTMM correlated slightly lower with all vari- 
ables. METRO LANG correlated considerably lower, .40 to .49, with all 
variables. These lower METRO LANG correlations apparently reflect the 
fact that it measures usage, punctuation and capitalization, parts of 
speech - grammar, and kinds of sentiences? activities substantially dif- 
ferent from those measured by the other tests. 

Table 4 indicates the total test score unrotated and rotated 



factor loadings, %s of variance accounted for by each factor, and eigen- 



values. 



Table 4 



Total 


Test 


Score 


Unrotated and 


Rotated 


Factor Loadings 






I 


U N R 0 T A T 
II III 


E D 
IV 


V 


R O T A T 
IT 


E D 
II 


CR SCI 


.80 


.24 


-.46 


-.14 


-.26 


.79 


.28 


CR SS 


.84 


.28 


.00 


-.16 


.43 


.85 


.27 


CT 


.78 


-.33 


.38 


-.34 


-.17 


.44 


.72 


CTMM 


.78 


.34 


.28 


.43 


-.12 


.83 


.19 


METRO LANG 


.67 


-.65 


-.22 


.27 


.11 


.16 


.92 


% of cf 2 


accounted for 


60.31 


15.57 


9.62 


8.31 


6.20 


59. 07 1 40 


• 93 1 



Eigenvalues 3.02 .78 .48 .42 .31 

^ % of o 2 of these two factors accounted for by these two factors only, 
not % of totaled 2 . 
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Means and standard deviations were respectively 22.22 and 6.29 
for CR SCI , 31 and 8.72 for CR SS , 31.19 and 7.74 for Cl, 5.49 and 
1.98 for CTMM , and 4.43 and 1.80 for METRO LANG . N was 37. 

Factor analysis indicated a general factor accounting for 60.? of 
the variance with strong loadings from all five variables. One other 
specific factor had a loading from METRO LANG about as strong as its 
loading on the general factor. 

Rotation sharpened the factor structure. The general factor be- 
came a group factor, accounting for 59 %, of the variance, consisting of 
CR SCI , CR SS and CTMM . It is difficult to interpret this factor pre- 
cisely because of the large number of skills purportedly tested, 15 
alone in CR SCI and CR SS not to mention CTMM . CTMM apparently measures 
logical reasoning, numerical reasoning, verbal concepts, and memory. 

This' factor is again seen as composed of language and thinking activities 
in varying degrees, particularly vocabulary, reading, interpretation. 
Inference, etc., similar to the subtests’ largest group factor. 

CT was separated from the general factor by rotation, and leaded 
with METRO LANG . This factor probably reflects primarily the different 
activities of CT IND and CT REL particularly judgments about the reli- 
ability of evidence and whether or not evidence supports a conclusion., 
as well as the skill and non-language components of METRO LANG . A 
question is the validity of CT, a test which has had relatively little 
validation. 

CONCLUSIONS 

1. Critical reading apparently consists of a number of reading, 
thinking and language activities particularly vocabulary as well as a 
considerable number of critical reading skills. It is separate from 
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study skill activities and also from reliability of evidence, and judg- 
ment whether or not evidence supports a conclusion. 

2. Critical reading seems to involve at least some activities 
different from those associated with the critical thinking test. Criti- 
cal reading also has considerable variance in common with critical 
thinking particularly CT PEP . 

3. Additional analyses of the two critical reading tests and sub- 
tests are in order, first and second order partial correlation, canoni- 
cal correlation, and particularly inter-item correlation, factor analysis 
and rotation to determine the factor integrity of the critical thinking 
skills jointly posited by Haney (1958) and Sochor (1958) . 

4. An admonition, the validity of any correlational and factor 
analytic study depends upon the reliability and validity of the tests 
and subtests used. 

Further, while these results should be interpreted as tentative 
because of the sample size, it is noted that the results are consistent 
with those of similar studies . 
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